Composite pairing and superfluidity in a one-dimensional resonant Bose-Fermi 

mixture 
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We study the ground-state properties of one-dimensional mixtures of bosonic and fermionic atoms 
resonantly coupled to fermionic Feshbach molecules. When the particle densities of fermionic 
atoms and Feshbach molecules are different, the system undergoes various depletion transitions 
between binary and ternary mixtures, as a function of the detuning parameter. However, when 
the particle densities of fermionic atoms and Feshbach molecules are identical, the molecular con- 
version/disassociation term induces a gap in a sector of low-energy excitations, and the remaining 
system can be described by a two-component Tomonaga-Luttinger liquid. Using a bosonization 
scheme, we derive the effective low-energy Hamiltonian for the system, which has a similar form as 
that of the two-chain problem of coupled Tomonaga-Luttinger liquid. With the help of improved 
perturbative renormalization group analysis of the latter problem, we determine the ground-state 
phase diagram and find that it contains a phase dominated by composite superfluid or pairing 
correlations between the open and closed resonant channels. 

PACS numbers: 71.10.Pm, 71.10.Hf, 51.30.+i, 03.75.Hh 



I. INTRODUCTION 

The Feshbach resonance yj], as experimentally real- 
ized in ultra-cold atoms/molecules in optical lattices, 
has made it possible to investigate the many-body 
physics of multi-component quantum degenerate mix- 
tures of fermions/bosons with inter-species interactions 
[2t6| . Operationally, a magnetic field near resonance can 
tune the energy splitting between different hyperfine con- 
figurations of atoms, yielding a tunable scattering ampli- 
tude with a magnitude that depends on the mismatch 
of the magnetic moments Q- In this context, theoretical 
studies have introduced two primary interaction vertices: 
A short-ranged, one-channel density-density type inter- 
action, and a two-channel interaction that couples open- 
channel atoms to a molecular boundstate (MB) particle 

Recently heteronuclear fermionic Feshbach molecules 
composed of bosonic ^^Na and fermionic ^Li [11|, and 
of bosonic ^^Rb and fermionic '"^K J^ have been ob- 
served experimentally, and attracted the attention of the- 
oretical studies |13l - [2l| focusing on the competition be- 
tween the condensed state of unpaired bosons and the 
degenerate MB particles with an additional Fermi sur- 
face. It has been arg ued that there can be depletion 
transitions [ij, [ij; ll3 where one or more of the atomic 
or molecular species can be exhausted by driving the for- 
mation or disassociation of MB particles. Furthermore, 
if bosons are condensed, the spectrum can be directly 
diagonalized, yielding MB particles that are dressed by 
free atomic fermions, which form low-energy quasiparti- 
cles in a Fermi- liquid theory [2l|. Additionally, the su- 
perfluidity of a paired state of a fermionic atom and a 



fermionic molecule, which is formed through attractive 
interactions mediated by the condensed and/or uncon- 
densed bosons, has been predicted to occur [1^. How- 
ever, it is questionable as to whether such features ob- 
tained by mean-field approach can persist when strong 
quantum fluctuations are present, especially for atoms 
trapped in one-dimensional (ID) tubes. 

There are many reliable analytical and numerical 
methods available for ID systems [22|, [2j]. In particu- 
lar, the bosonization technique has been applied to one- 
channel systems with density-density type interactions, 
showing pairing a.nd density- wave instabilities 1241 . po- 
laronic phases [23, ^6] , and competing orders [23| • The 
dominant phases exhibit variants of "paired" order pa- 
rameters with algebraic decay or quasi-long range or- 
der (QLRO) |24l - [26| . Systematic analysis has also been 
performed for a two-channel type model arising from 
atom-molecule mixture, expected for narrow resonances 
|28l [201; however, these works were concerned only with 
the bosonic MB particles composed of the same species of 
fermionic atoms. The possibility of more complex pair- 
ing and superfluid orders that couple the open and closed 
fermionic channels has not been observed experimentally 
or discussed theoretically in detail. 

In this paper, we study a general two-channel model 
of fermionic and bosonic atoms near a narrow Feshbach 
resonance where bosons, fermions, and molecules can co- 
exist. Using a renormalization-group (RG) method based 
on the bosonization formalism, we obtain low-energy the- 
ory and attempt to clarify the ground-state phase dia- 
gram, with an emphasis on the conditions that allow the 
pairing of the fermionic atoms and molecules across the 
Feshbach resonance. In doing so, we make use of the 



analogy to the two-chain problem of coupled Tomonaga- 
Luttinger liquid (TLL). The paper is organized as fol- 
lows. In section II, we introduce the model and exam- 
ine the condition for ternary mixed phases of bosonic 
atoms, fermionic atoms, and fermionic molecules. In sec- 
tion III, the ternary mixed phase is studied and possible 
order parameters are introduced to characterize QLRO. 
We determine the phase diagram for the case of incom- 
mensurate density regime of fermions and molecules. In 
section IV, the RG method is applied to analyze the low- 
energy properties, and in section V, the phase diagram 
is determined for the commensurate density regime of 
fermions and molecules. Section VI is devoted to conclu- 
sions. The RG approach based on bosonization to the 
spinless two-coupled chain is revisited in Appendix. 



II. MODEL AND CONDITION FOR TERNARY 
MIXED PHASE 



not conserved; instead, the total numbers of bosonic and 
fermionic atoms. 



(2.3a) 
(2.3b) 



are conserved quantities. It follows that the masses {iris) 
and the chemical potentials (/is) obey the sum rules for 
mass conservation and chemical equilibrium: 



TVs ^ dx [pb{x) + Pi,{x)] , 
Mf ^ dx [pf{x) + p^{x)] , 



mb + mf ^ m^,, pb + Pf = Pi,, 



(2.4) 



Model Hamiltonian 



and the detuning parameter v in Eq. (j2.2cp defines the en- 
ergy splitting between the open and closed channels. The 
fermionic intra-species couplings, Vff{x), and T^^^(a;) are 
assumed to be short-ranged. The b atoms interact with 
each other through the coupling Vbb{x). At strong repul- 
sion, the boson system is described by an ordinary Tonks- 
Girardeau (TG) gas which behaves as free fermions. 



Our starting point is a coupled, two-channel model of a 
resonant scattering from bosonic (b) and fermionic atoms 
(/) into fermionic Feshbach molecules (ip). The model 
Hamiltonian is given by 



H = Hb + Hf + iJ.^ 



H: 



3pi 



(2.1) 



where 
Hb 



dx'^lix 



1 d2 



Pb *6(a;) 



H,=jdx^)ix){-^^ 



2mb dx^ 
dxdx'Vbbix — x')pb{x)pb{x') 
d^ 



(2.2a) 



dx'^ 



Pf *^(a;) 



dxdx'Vffix - x')pf{x)pf{x'), (2.2b) 



H,i, 



i'= d^%ix) 



1 



2m^ dx'^ 



t-i/j 



+ v-p^] *^(a;) 



-I- - / dxdx'Vi;i;{x - x')p^{x)p^{x'), (2.2c) 

Hzp = 53p / dx \^\{x)-^f{x)-^b{x) + H.c] , (2.2d) 

and we have set h = 1. The density operators are 
Ps{x) = '^\{x)'^ s{x) , (s = b,f,tp), where the field op- 
erators ^s(a;) obey the usual commutation and anti- 
commutation relations for bosons (s = b) and fermions 
(s = f,ip)- The Hamiltonian Hs {s — b, /, ip) consists of a 
kinetic energy term and an intra-species density-density 
interaction term. The coupling g^p in Eq. (j2.2dp induces 
the conversion of bosonic (&) and fermionic (/) atoms 
into fermionic MB particles {ip) and vice versa (disas- 
sociation) [8|, [lOJ. The individual particle numbers are 



B. Phase diagram in the limit of g^p 







Before proceeding to the many-body features of the 
model described by Eq. (|2.ip . it is important to first es- 
tablish the range of physical parameters that allow the 
ternary coexistence of all atoms and molecules. For sim- 
plicity, we will consider the limit g^p — >■ 0, with Tonks- 
Girardeau bosons [Vbbix) = gb5(x) with gb — ?► +oo], 
and non- interacting fermions and molecules [V//(a;) = 
K/.V {x) = 0] . As noted in Ref. [la, we can construct the 
dimensionless independent parameters A/i^/A/s, rnfjmb, 
and v /Tq^ where Tq is the "Fermi" degeneracy tempera- 
ture for hard-core bosons: Tq = 7r^A/'^/(2mf,L^), with L 
being the system size. 

Let us introduce the average particle density p^ = 
L~^ J Ps{x)dx, and the corresponding normalized quan- 
tity ps = Lp^/Mb- The conditions for the conserved 
total numbers of atoms [Eqs. (|2.3I) ] are expressed as 
1 = Pb + Pip and Af/A/b = Pf + p^,, respectively. 
For hard core bosons, free fermions, and free molecules, 
the chemical potentials are given by pb — (fc^)^/(2mb), 
Pf — (fc^)^/(2m/), and p^, = (fc|^)^/(2m^) + v, where 
the "Fermi momenta" for each species are given by 



■^Ps 



(2.5) 



The particle densities can be determined from the equi- 
librium condition of Eq. (j2.4[) . In the ternary mixed 
phase of b, f and i/j particles {b+f+ijj phase), the density 
of molecules p^ is determined by the equation: 



(1 - Pi,f + -^— (Afp - p^y 

mf 



1 



nif 



[Pif + D, (2.1 



where Afp = A/f/Ab, m/ = mf/mb, and i^ = i^/Tq. 
The densities for b atoms and / atoms are determined 
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detuning v/Tg 

FIG. 1: (Color online) The normalized particle densities 
ps = LfSilMu as a function of the detuning parameter v. 
In this figure, we choose m^ — ruf and Nf /Mb ~ 3/2. At 
v/To = 11/32, the densities of fermions and molecules become 
equal pf = p^ = 3/4. 



by p& = 1 — Pi/; and pf — Afp — P0, respectively, and 
the expected v dependence is shown in Fig. [1] Notice 
that in the case of sufficiently strong positive detuning, 
the ip particle is completely depleted and only the b and 
/ atoms remain. We thus label this binary mixture the 
"b+f" phase; effects of possible heteroatomic interactions 
in this reg ime have been analyzed in the literature [2J- 
\2l\ . 130 . l3l| , where it has been pointed out that the excita- 
tion spectrum can have a gap and the pairing fluctuations 
are enhanced when the particle densities of two kinds of 
atoms become equal. On the other hand, the MB parti- 
cles become stable for sufficiently strong negative detun- 
ing; for Mp/Mb < 1 (> 1), either b or f atoms coexist 
with the ip particles and the resulting binary mixtures 
are labeled "b+ip " and "/-l-V' " phases, respectively. 

The phase diagram in terms of the detuning parameter 
V and the total fermion number Afp is shown in Fig. [21 
which can be contrasted with the corresponding phase 
diagram in the three-dimensional (3D) case (see Fig. 3 
in Ref. d^, Fig. 3 in Ref. [H and also Fig. 1 in Ref.lll) 
where the Bose-Einstein condensate (BEG) proliferates 
everywhere except for the small u and large Afp region 
corresponding to the f+tp phase in Fig. [5] In the present 
ID case, no BEG can occur in any parameter region, but 
a "Fermi surface" of the 6 atoms can be observed instead. 
With this in mind, we find qualitative agreement with our 
phase diagram for ID mixtures and that for 3D mixtures. 
The densities of fermions and molecules become identical 
(p/ — p^) in both ternary and binary mixed phases for 
a particular D satisfying 



1 + mt + ml _ „ 



v = < 



-(- 

4 \mf 



Amf{l + mf) 
1 



l + ruf 



M 



^F (b+f+i^ phase), 
{f+tp phase). 



(2.7) 

which is represented by the dashed line in Fig. [51 The 
analysis given in Ref. l24J may be applied to the case 
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detuning v/Tq 

FIG. 2: (Color online) Phase diagram in terms of the detun- 
ing parameter v and the fermion number A/f, for the case of 
equal masses mt — mf. The ternary mixed state of bosonic 
atoms, fermionic atoms, and Feshbach molecules is realized 
in the region denoted by ^^b+f+tp". The regions denoted by 
"/+V'") '^b+tp" , and "b+f" represent the fermion-molecule, 
boson-molecule, and boson-fermion binary mixed phases, re- 
spectively. Along the dashed line, the densities of fermions 
and molecules become equal, p/ — pi,- 



Pf ~ Pi' ^^ ^be f+ip phase. However, the spectrum 
for the case pf = p^ in the b+f+tp phase has not yet 
been analyzed so far. In the following sections, we study 
phases realized inside the b+f+^p phase upon turning on 
the 53p coupling. 



III. BOSONIZATION 
A. Bosonized Hamiltonian 

The dominant low-energy behavior of the model de- 
fined by Eqs. (|2.2p can be studied by using a harmonic 
fluid representation, where the single-particle dispersion 
relations are linearized near the "Fermi" points. In the 
problem of BEC-BGS crossover in one dimension, a two- 
channel model of two-component fermions that dimerize 
into bosonic molecules has been previously analyzed by 
means of the bosonization method in Refs.[28land[29l. Be- 
cause of the different statistics of particles, the bosoniza- 
tion analysis of the present model will reveal different 
phases. 

In terms of the bosonic phase fields 6Ax) , the density 
operators can be expressed as [22, [2j, [S^l 

Ps{x) = p2 - z^^ + P° E e^''"!^''"--*^^-)], (3.1) 



TT dx 



m^O 



where pi is the equilibrium density and the summation 
is over nonzero integer m. The field operators for the 
respective particles are represented as [23, 123, [33] 

V27ra ~i 



^H^/"{x) = ^^e'F*[''''^~"^^"('^^l+^^^(''\ (3.2b) 

V27ra 

^-^/-"■(a;) ^ ^^gTikP°a:^-0V'(:r)]+i9v,(:i:)^ (3.2c) 

\/27ra 

where a is a short-distance cutoff. The field opera- 
tors ^f" and '^f (s = /, V') represent the left-moving 
and right-moving chiral branches of fermionic particles, 
respectively. The Klein factors ^/ and ^^, satisfying 
ICsj^s'} = 2i5s,s' and ^| = ^s, are introduced in order 
to retain the anti-commutation relation between / and ip 
particles. The phase fields ds{x) are dual fields to (j>s{x), 
and obey [(j)s{x),9s'(x')] = iTTSs,s'Qi—x + x'), where 0(a;) 
is the Heaviside step function, i.e., <d{x) — 1 for a; > 0, 
6(0) = i, and Q{x) = for a; < 0. By introducing 
the conjugate momenta Hsix) = {1/ 1^)8x0 s{x), a generic 
TLL Hamiltonian for each component is expressed as 



Hs = ^Jdx |i^,[^n,(x)]2 + ±[dx^^(x)A 



(3.3) 



The parameters Us and Kg are velocities and TLL param- 
eters, respectively, which depend on the precise forms of 
microscopic intra-species interactions. We will consider 
the general case where < Ks=bj,ip < oo. The non- 
interacting limits Vbb — >■ and Vff, V^^ — )• correspond 
to Kb = oo and Ks=f.ip = 1, respectively. By tuning 
fffc — » oo, the system enters the TG regime at Kb ^ I 
[23l |33 |. For specific realizations of optical lattice sys- 
tems, the commensurability of the Bose-Hubbard inter- 
action allows the possibility of tuning into the regime 
Kb < 1, when Vbb is long ranged 23, 32]. 

After substituting the bosonized form of \E's(a;) defined 
in Eqs. p.2p into Eq. (j2.2d|) and keeping only the n = 
term for ^h, we obtain 



Hsp = -i-hp / da; cos [^^(x) -I- 9f{x) ~ 0-4,{x)] 

X sin[(f)f{x) — (f>^{x) — Skpx], (3.4) 

where Skp = kp — kp and 33^ = 4(73p(27ra)~^/^. In de- 
riving Eq. (13. 4p we have discarded terms like ^3^ sm{6b + 
9f ~ 6^) cos(2kFX ~ (f)f ~ (j)^) which are strongly irrele- 
vant in the RG sense because they have spatial oscilla- 
tions with the wave number 2kF ^ kp + kp — ttMf I L. 
Furthermore we have replaced £,fS,Tp with -|-i, because the 
product of the two Klein factors is a constant of motion 
[the identity (C/Ci/i)^ — ~1 implies either £,fiip = +i or 
— i, and we have chosen the former]. We will use the same 
sign convention when we derive bosonized form of order 
parameters. 

In the incommensurate case {5kp ^ 0), the gy,p inter- 
action [Eq. p.4p ] is irrelevant in the low-energy or long- 
distance physics. The analysis of the previous section is 
then applicable, and the phase diagram can therefore be 
determined as in the previous section, with various de- 
pletion transitions occurring between binary and ternary 
mixture phases. On the other hand, Eq. p. 41) has a 
dramatically different effect for the commensurate case 



{Skp = 0), which is satisfied along the dashed line in 
Fig. m In this case, sinusoidal potentials can lock a par- 
ticular phase variable {9s or (jjs), and a competition of 
various orders due to the phase locking must be studied 
by performing a RG analysis. 



B. Order parameters 

In the context of quantum mixtures, composite "pair- 
ing" correlations have been previously introduced in the 
literature and will be extended here to a more compre- 
hensive list of possible order parameters. First, the con- 
ventional 2kF density-wave (DW) order parameters are 
given by 

Of'^ix) = ^l{x)^b{x) ~ e'(24--2*->)^ (3.5a) 
O^'^ix) = *^^(a;)*f (x) ~ e*(24--20/)^ (3.5b) 
aDW(a;) = ^i,^^{x)^R(x) ~ e*(24-20v,). (3.5c) 

Here (and below) we have dropped unimportant numer- 
ical pref actors. In analogy with order parameters in the 
spinless two-coupled chain system [see Eq. (jA4al) ]. we in- 
troduce the out-of-phase DW state of / and tp particles, 

O^^ix) = ^'}Hx)^fix) - ^^\x)^^{x) 

~ e'2k^^-t(^f+M sm{(j)f -cj}^- Skpx). 

(3.5d) 

Next, the order parameters for the superfluidity (SF) 
of bosons, p-wave-paired fermions, and p-wave-paired 
molecules are given by 

Ol''ix) = ^bix)^e''\ (3.5e) 

Off{x) = '^j{x)'^f{x)^e'^'^f, (3.5f) 



OZi^) = Hi^)'^^i^) ^ e 



i2e^ 



(3.5g) 



We will also consider the p-wave-paired SF state com- 
posed of / and ip particles, 

0%ix) = ^'f{x)^^ix)-^fix)^^ix) 



„«(e/+e^), 



M(f>f 



Skpx), (3.5h) 



which is odd under the parity transformation L -(^ R, 
implying p-wave pairing. This order parameter can be 
identifled with the interchain pairing SGd state in the 
two-coupled spinless chain problem [see Eq. (|A4cp ]. if the 
species / and ip are regarded as the chain indices. 

Earlier work in Ref. |33| investigated the phase diagram 
of interacting "6-|-/" binary mixtures near the commen- 
surate point pb = Pfi where the composite p-wave super- 
fluidity ^ ^I'^^^^I'? was shown to have dominant QLRO 
correlations. In the ternary system studied here, similar 
orders can persist: 



o!Jf+bf^4^) = ^b^M + *i*^*^ 



~ e'(^^+^*)cos(0fc + 0/-0,0), (3.5i) 

which describes the p-wave pairing of two fermionic (/ 
or -0) particles combined with a single b atom. Note that 
the two composite operators in Eq. p.Sip . vj^^vj/^il/^ and 

^h^V"^^' annihilate equal numbers of fermionic/bosonic 
atoms (including the ones forming a molecule), as 



seen from the commutation relations [Mb , Of^ 



_(nSF 



and [AfF,Of 



20W+.t^^- This 



'bff+bW'P' 
order parameter corresponds to the intrachain SCs pair 

ing in the two-coupled chain problem [see Eq. (|A4d|]. 

In addition, we consider other composite order param- 
eters defined by 



O 



phi 

fet/tV- 



t,T,it, 



(x) = -^i^y-^ 



V. 



*6*f^*^ 



/ 



^iSkFX — i{tt>i — (t)^) , 



^i(-2k''p+SkF)x+i{2c/,t-<pf+<p^,) 



X cos[9b + Of 



O 



ph2 



(x) 



*^*/ 



* 






i2kFX~i{<pf+4,^) ^Qg/Q 



'b + Of 



'i') 



(3.5j) 



(3.5k) 



which represent the particle-hole combinations of / and ^ 
fermions. These operators are composed of the products 



(tiT(t 1 



,t 



of three field operators, ^^^l^^ and ^;,^i\I>/, which are 
similar in form to the g^p term of Eq. (|2.2dp but asym- 
metrical in the L, R branches. The second bosonized con- 
tribution in Eq. ( 3.5JP , coming from the n — ~1 contribu- 
tion in Eq. (j3.2al) . can become a dominant order param- 
eter for some parameter regime, as will be shown later. 
We also note that the order parameter in Eq. (j3.5k[) cor- 
responds to the "orbital antiferromagnetic state" in the 
two-coupled chain problem, in which circulating currents 
flow between the two chains, if the / and ip indices are 
regarded as chain indices [see Eq. (|A4bp ]. 



Ground states in the incommensurate case 



When Skp ^ 0, the 53^ interaction of Eq. (|3.4p oscil- 
lates in space and does not affect the low-energy spec- 
trum. Thus we can set g^i^ = in the low-energy limit, 
and the system is described as a three-component TLL, 
in which the 6, /, and 1/' particles are decoupled and the 
correlation functions exhibit algebraic decay. For exam- 
ple, the correlators for the h particles are given by 



Of(x)Oft(0) 



oY^{x)oY^\^) 



^1/(2^6) 



-2/f6gi2fe° 



(3.6a) 
(3.6b) 



We find that the superfluidity correlation dominates over 
the density-wave correlation when K\, > 1/2. Similarly, 
the correlation functions for the p-wave superfluidity and 
the density-wave of the / and ^ particles exhibit alge- 
braic decay. 



(Off (x) Off (0))^ ^ ^ 



-2lKs 



(3.7a) 



where s = /, f/). The dominant correlation for fermions 
changes between the superfluidity and density-wave or- 
ders at Kg = 1. In Fig. [2{a) we show the phase diagram 
in the parameter space of Kg (s — b, /, ip), which is ob- 
tained by identifying the dominant QLRO among those 
in Eqs. (EH) and (P7|) . 



IV. RENORMALIZATION IN THE 
COMMENSURATE CASE 

When Skp — 0, effects of the sinusoi dal p otential , , 

can be analyzed using RG techniques ^32l|. Apparently, 
the form of Eq. p.4p contains dual fields which do not 
commute [Ob + Of — 0^,(l)f — (j>Ti,] ^ 0. This type of interac- 
tion has been analyzed in the context of two TLL chains 
coupled by one-particle interchain hopping [3J, [33. It 
has been confirmed that higher-order corrections are cru- 
cial to determine the low-energy spectrum of the two TLL 
chains 36]. We can thus expect that interactions gener- 
ated by RG transformation should similarly be taken into 
account in our model. 

In this section we set Ub = Uf = u^{= u) for simplicity. 
The Euclidean action of the system is given hy S — Sq + 
Si.o + Sri + Si,2 + Si,3 with 






^/,i 






ITT a 



9b + 0f-0^)sm{(j)f 



^1,2 — 

c. Ge 

Sl,3 = — 

TT 



^cos(20/ - 20^), 
-^cos{20b + 20f~20^), 



(4.1a) 
(4.1b) 

(4.1c) 
(4.1d) 

(4.1e) 



where V — {dx,u~^dr), (Pr — udxdr, G^p — ■na^g^p/u. 
Although the extra terms G^, Gg, Gh/, Gbip, and G/^, 
are absent in the original Hamiltonian, they are gener- 
ated through the RG process 35] . 

In this__paper, we adopt the momentum-space RG 
method [37J, by introducing the momentum space cut- 
off A. The RG equations can be obtained by integrating 
out the high-momentum components A' < \k\ < A, where 
A' = A(l - dl) is the reduced cutoff {dl = -dk/h). Ac- 
cordingly, the phase fields 4>s [x] are split into two compo- 
nents 4)s {x) = (j)'g (x) + hs {x) [33] , where 0^ (x) is the field 
having components in lower momentum < \k\ < A' and 
hs{x) has higher momentum components A' < \k\ < A. 
The free propagators for these fields are given by 



b's{r)^'sm - ^-gir) - ^ 



CX3 77 

-Jo(fcr)/(fc/A'),(4.2) 
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FIG. 3: (Color online) Phase diagram of Hamiltonian (|2.ip for the incommensurate case p/ 7^ p^ (a) and the commensurate 
case pf = p^ (b). For simplicity we set Ub — Uf = u^ and K^ — Kf. The regions labeled by DW and SF represent phases 
with the dominant density-wave and superfluid correlations, respectively. The dominant correlation crosses over from DW to 
SF or vice versa across the dashed lines, (b) In the phase denoted by "(3 component TLL)", all the couplings Gap, G^, and Gg 
are irrelevant in the RG sense. The boundary between the phases of relevant G0 and that of relevant Ge is shown by the thick 
solid line at which the system undergoes a quantum phase transition. On the left-hand (right-hand) side of the thick solid line, 
the coupling G^ {Ge) becomes relevant. 



{h,{r)hM) = ^Sgir) 

= ^l -^Mkr)[f{k/A)-f{k/A% 

(4.3) 

where f{p) is a cutoff function and Jo{z) is the Bessel 
function of the first kind. We use the smooth cutoff func- 



tion f{p) = l/[(p/c)^ -|- 1] [3^, where the constant c is 
taken as c = 2e~'''/(Aa) in order to reproduce the asymp- 
totic form {[4>s{'r) — 0s(O)]^) = Ksln{r/a) for r — > 00. 
By exploiting the commutation relation [(J3s{x), 9s' (x')] — 
iirSs^s'^i—x + x') and the normal ordering procedure for 
the operator-product expansion [32|, |39|, the RG equa- 
tions are obtained; 



J 



dG: 



3p 



dl 

dl 

dGe 
dl 



- (2 - Kf -K^- 2Gf^KfK^)G^ + ^G^ A^{{K-' + Kj' + R-' -Kf- K^,)/A), 
^ (2- — ^ — -2G^. + 2G^.,. + 2G <:.,.] Gn 



dKb 

dl 

dKf 

dl 
dK^ 

IF 



-TT - -r? -7? 26*6/ + 2Gh^ + 2G/^ Gq 

y Ab Kf K^ J 

+ GlA2{K-^ + Kj'+K-^), 

- Gl Kj A2{Kf + K^) + GlA2{K^^ + Kj' + K^% 

- Gl Kl A2{Kf + K^) + Gl A2{K^' + Kj' + K^^), 



dG, 



bf 



dl 



dG, 



- + -^ A2(K-^ + KV^ + K7^) 



-bil> 



G a 



dl 

dGftp 



^^A.(i.- + i.7^ + x- 



. '2 
f2 



dl 



= -Gl A,{Kf + K^) + -^ A^iK-^ + KJ^ + R-^) 



(4.4a) 
(4.4b) 

(4.4c) 
(4.4d) 
(4.4e) 
(4.4f) 
(4.4g) 

(4.4h) 

(4.4i) 




J I 



'3p 








-^^ 




b 



FIG. 4: Diagrammatic representation of the Gsp, G4,, and 
Ge terms, and low-order contributions to G^ and Ge- Tiie 
dasiied, sold, and double lines represent the boson, fermion 
and molecule propagators, respectively. The wavy-line repre- 
sents the intra-species density-density interaction. 



where we have defined 



dr 



Aiip)dl = 2(3 —Lsg{r)e-^mo)-gir)]^ (45a) 



a a 
dr r 



A2{l3)dl = 2l3 'fL'5g{r)e~^mo)--9{r)\, (4.5b) 



a Qf"" 



The exponential factors in the rhs of Eqs. (|4.5p appear 
as a result of normal ordering in operator-product expan- 
sions j32i, BSj: for example, 

cos.\p4''s{ri) + q<t>'s{r2)] 

= :cos[p0Un) +#s(^2)]: e-^(p'+«')<^">-P«<^'=(i)'^^(2» 

« : cos [(p + <?)</); (i?)]: e-5(p^+?^)(*l'>-P9(*Ui)0'.(2)) 

= cos [{p + q)cj,',{R)] ei[(P+«)'-(p'+«')l<^l'>-P«<*Ui)*l(2)> 

= cos[{p + q)(t,'^{R)] e5P9^[9(")-9('-i=)l, (4.6) 

where i? = (ri + r2)/2 and ri2 — ri — r2- We note that 
Ai(/3) « 62-^/3 for small /3, and yli(l) = ^2(2) = 1, where 
7 is the Euler-Mascheroni constant. One can neglect the 
velocity renormalization up to one-loop order. The initial 
values of the RG equations are given by 6*3^(0) = G^p, 
Ks{0) = Ks, and G,,-(0) = G^(0) = Gg{0) = 0. 

Diagrammatic representations for the Gap , G^ , and Gg 
terms are shown in Fig. S) The G^ coupling is a four- 
point vertex representing interactions between / and i\) 
particles, while the Gg coupling is a six-point vertex for a 
two-molecule conversion from two h and two / particles. 
Low-order contributions to G^ and Gg are also shown 
in Fig. m The lowest-order contribution to the G^ cou- 
pling comes from the effective interaction mediated by h 
atoms. Pairing between fermions (/) and molecules (V') 
induced by such boson (6) mediated interaction has been 
suggested in Ref. [l^. We will contrast this paper with 
our work in more detail later. 

Since [0/ — 0,/,, 0b + 0/ — 0i>] 7^ 0, the phase variables 
(\)f — (j)^ and Oh + Of — 9^ cannot be locked simultaneously. 



This means that there should be two distinct phases sep- 
arated by a quantum phase transition, a phase where 
4>f ~ 't'lp is locked by the G^ term and a phase where 
Ob + Of — 0^ is locked by the Gg term, in addition to 
a three-component TLL phase where none of the phase 
fields is locked. Here we obtain the phase diagram by 
comparing the scaling dimensions, which we denote by 
dim[ ], of the operators for the couplings G^p^ G^, and 
Gg. We ignore renormalization of Ki,, Kf, and K.^f, for 
weak gsp, because the rhs of Eqs. (j4.4dp - ()4.4fj) are of order 
g^ . The scaling dimensions of the sinusoidal potential 
operators are fomid from Eqs. (|4.4al) - (|4.4cp as 



dim[G3,] = i(i- + ^ + ^+X, + i^,,, 

dim[G0] = Kf + K^, 

1 1 1 



(4.7) 



dimfGfl 



Kh Kf K^ ■ 



In the case when three inequalities, dim[G3p] > 2, 
dim[G0] > 2, and dim[Ge] > 2, are simultaneously sat- 
isfied, all the locking potential operators are irrelevant, 
and consequently, we have a 3-component TLL phase. 
This is the case for large Kf and K^ and small Ki,. Oth- 
erwise, either the coupling G^ or Gg becomes relevant 
and flows to strong coupling at low energy. 

We observe from Eqs. (j4.4bp and (|4.4cp that the con- 
dition 

Ks + K^ = ^ + ^ + ^ (4.8) 



Kb K 



f 



Ki, 



defines the special situation in which the scaling dimen- 
sions dim[G0] and dim[Ge] become identical and the fac- 
tor >li in the second terms of the rhs of Eqs. (j4.4bp and 
(|4.4cl) vanishes. Thus, Eq. (|4.8I) determines the phase 
boundary between the phase where the G^ operator is 
relevant and the phase where the Gg operator is relevant. 
In the case where Kf+K^ < K^^+KJ^ + K~^, the cou- 
pling G^ is relevant and renormalized to strong coupling 
with G^ > 0. We note that the positive G^ coupling 
implies repulsive density-density interactions between / 
and ip particles. On the other hand, in the opposite 



case where Kf 



K^ < K-^ + K-^ + K- 



the cou- 



pling Gg is relevant and renormalized to strong coupling 
with Gg <0. 

The resulting phase diagram is shown in Fig. [2I^b), for 
which the nature of the ground state in each phase is 
discussed in the next section. 



PHASE DIAGRAM IN THE 
COMMENSURATE CASE 



In the preceding section we determined the phase 
boundaries in the phase diagram that admit quantum 
phase transitions. Therefore, in a given region of rel- 
evance where a particular phase variable is locked, the 
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properties of the resulting phase that may exhibit dom- 
inant QLRO can be understood by analyzing the expo- 
nents of the order parameter correlations. For this pur- 
pose it is necessary to make transformation to a suitable 
basis. 



A. Recombination of phase variables 

We perform the following canonical transformation: 

ip{x)=P(t){x), ^{x) = Qe{x), (5.1) 

where 





(5.2a) 



(5.2b) 



The transformation matrices P and Q are generally non- 
orthogonal, but the commutation relations of (p and i?, 
[iPa{x),Tr~^dy'di,{y)] — i5a^b^{x — y), are preserved as long 
as the relation PQ"^ = 1 is satisfied [40|. A simplifica- 
tion of Eq. (|3.4p follows from the following choice of the 
matrices: 




Substituting the phase variables if and i9, we rewrite the 
cosine terms in Eq. (|4.ip as 



^7.1 = -I— I ^ cos(V2i?3) sin(y2<^3), (5.4a) 



Si,2^^ f^cos{2V2ip,), 
S,,,^^ f^cos{2V2^,). 

TT 7 Ct 



(5.4b) 
(5.4c) 



We note that the phase variables 1^93 and ^3 are subjected 
to the G^ and Ge cosine potentials, respectively. In terms 
of the phase variables (fi and 1?, the TLL Hamiltonian 
(13.31) is rewritten as 



Hq — Hi, + Hf + H^ 

(5.5) 



where M and N are real symmetric matrices defined by 



-1 



M-\ 



N ^ - 
2 



UbK^^ -MfcX 

UfKj^+i 

-UbK^^ UfKJ^ - u^K~^ UbK^ 

4:UbKh + UfKf + u^K^ UfKf ~ u^K^ UfKj + u^K^ 
UfKf -u^K^ UfKf + u^K^ 

UfKf +u^K^ 



UfKj 1 - u,pK^ 1 
"' ' UfKJ^+u^K-^ 



UfKf - u^K^ 



Ki 



UfKf - u^K^ 
UfKf + u^K^p 



r 



(5.6a) 
(5.6b) 



The order parameters introduced in Sec. lIIIBJ can now 
be expressed in terms of the new phase variables 93 a-nd 
■j9. The order parameters for the b particles are given by 



Of (x) ~ e-'^''\ 

O^^(x) ~ g»2fe^a:+i\/2ipi-i%/2<^3 



(5.7a) 
(5.7b) 



The order parameters for the p- wave-pairing SF and out- 
of-phase DW states of the / and -0 particles are written 
as 



OfJx) ^ e^^''^ sm{V2ip,l 



(5.7c) 



071{x) 



e'^'''=-^''-^V2 sm{V2ip3), 



^fip {X) — c ' ■ ' - sm(^v ^^3), (5.7d) 

from which it follows that correlations of SF^^ and 
DW/^ are enhanced when the phase field (ps is locked 
at (v^i^s) = 7r/2 mod tt. Finally the order parameters 
for the composite particles are expressed as 

OtJ^^,,^^ix)^e^^'^^cos 



^b'lf'ii,^^) 



(^^^3), 



(5.7e) 



e"'^^^ sin(\/2z93) 




-fe~'24--«v^vicos(y2^3), 


(5.7f) 


e'2'=^^-*^'^^cos(%/2i93). 


(5.7g) 



We see that the correlations of these order parameters are 
enhanced when the phase field 1^3 is locked at {^/i-dz) — 
mod TT, except for the first contribution in Eq. (j5.7f|) . 



ables [if, -d) and {(f, d) are given by 

^1 



^2 



= P 



<^2 



,,j-Q[Z)^ (5-10) 



B. Effective low-energy Hamiltonian 



The sinusoidal potentials in Eqs. (|5.4p take on forms 
similar to the nonlinear potentials in the spinless two- 
coupled chain system [3^ i3||] (see Appendix). In the 
two-chain system an operators generated in RG transfor- 
mations becomes relevant in the low-energy limit. Simi- 
larly, we expect that either the G^ or Gg potential term 
become relevant and renormalized to strong coupling, as 
we have discussed below Eq. (|4.8p . The relevant G^ > 
leads to locking of the phase field (^3 at {'\/2ip^) = 7r/2 
mod TT, whereas the relevant Gg < leads to locking of 
the phase field dz at (-\/2t^3) = mod tt. When either 
ipz or z?3 is locked, the remaining phase fields (ps and -dg 
{s = 1,2) remain gapless, and then the system is effec- 
tively described by a two-component TLL and a massive 
sine-Gordon model. However, in contrast to the simple 
forms of sinusoidal potentials, the quadratic Hamiltonian 
in Eq. (j5.5p is complicated by the presence of many cross 
terms. One approach that we will implement here is to 
integrate out the massive mode (ip^, ^3) in a manner sim- 
ilar to Ref. Hi], thereby reducing the problem to a two- 
band system which can be exactly diagonalized. To be 
more precise, when Gcf,{l) — >■ -|-oo in the RG analysis, the 
quantum fiuctuations of the tp'i field are suppressed, and 
we can make the approximation dxPz — >■ dxips) ^ 0. 
Moreover, since the cosine potentials can be ignored for 
the strongly fiuctuating d^ field, d^ can be integrated 
out by completing the square for dx'&s in the quadratic 
Hamiltonian, as described in Ref. 41. The same approach 
can be used for Gg{l) — >■ —00. Consequently, the system 
can be described effectively by the two-component TL 
liquid with the effective low-energy Hamiltonian 



H^*^- 



E 



f dx - 

/ — ( Mi J dxPidx (fij + Nij dx-did, 



.^.), 



(5.8) 

where (p'^ = dx^i and 1?^ = dx'&t- In the case when ip^ is 
locked (G^ — > 00), the renormalized coefficients are given 
by M„- = M,j and N,^ = N,^ - N^N^s/Nss {i,j = 1, 2). 
Similarly, when 1^3 is locked {Gg — )■ —00), the coefficients 
are given by Mij = Mij — MisMj^/M^s and Nij = Nij. 
The Hamiltonian (|5.8p can be diagonalized sequentially 
[40], yielding 



H-^ = ^ I dx 

27r 



{dx^i? + {dx^if 

{dxP2f + {dxd2f] . (5.9) 

The canonical transformation between the phase vari- 



l^''^" 



where the transformation matrices P and Q are defined 
as P = i?iA7^^^i?2A2^^ and Q = RiAy^R2A~^^'^ with 
Ai and A2 being diagonal matrices. Here the rota- 
tion matrix Ri diagonalizes the matrix M as RJMRi = 
Ai, and the rotation matrix R2 diagonalizes the matrix 
aY^RJNRiAY^ = R2A2RJ. The velocities m and U2 
are diagonal elements of A2 



1/2 



C. Correlation exponents 

In this section we calculate correlation exponents for 
order parameters characterizing the phases in Fig.[3][b). 

For the Gaussian model (|5.9I) , the correlation functions 
of vertex operators, exp{iXiPi) and ejip{iXi'&i) with real 
parameters Ai_2, show power-law decay, 



i\iipi(x)+i\2ip2ix) -i\iipi{0)-i\2ip2iO) 



giAiiJi(2;)+iA2i?2(2;)g-iAii?i(0)-iA2i?2(0)\ 



X 2' 



(5.11a) 
(5.11b) 



where the exponents are given by 

Vv^ = E ^J' '?^i2 - Y. ^iJ^2,' (5.12a) 

j=l,2 j=l,2 

Vm = E ^^r '^''12 == E Q^iQ^]- (5.12b) 

J = l,2 J = l,2 

These results can be applied to the cases of interest. 



1. Case of relevant G^ 

In the case when G^ is renormalized to strong cou- 
pling (G^ -^ 00), the fiuctuations in the d^ field di- 
verge, and consequently, the order parameters that con- 
tain the vertex operator of dz exhibit short-range corre- 
lations or exponential decay at large distances. On the 
other hand, the locked field p^ can be replaced with its 
average {y2p3) — tt/2 mod tt in the order parameters 
that contain ip^, . The correlation functions for the boson 
order parameters are then given by 



Of(x)Oft(0) 



O?W(^)0DWt(o) 



-1/(2^6) 



^-2A:fcgj2feJ 



(5.13a) 
(5.13b) 



We note that the exponents are unchanged from those 
in the g^p = case [see Eq. p.6p ] and that the corre- 
lation functions of b particles are controlled by the TLL 
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parameter K^. The SFf, is dominant for K^ > 1/2, while 
the DW(, becomes dominant for K^ < 1/2. For / and ip 
particles, slowly-decaying correlation functions are given 
by 



(^ 


%i^)o%Ho)) 


^ a;-l/^^ 


(5.14a) 


or(-)0/T(o)> 


^ ^-K2^l2kFX 


(5.14b) 


= 2 




1 1 M 

1 


-1/2 


UfKf u^K^J 





where 



K2 

(5.14c) 

The most dominant order for / and tp particles is deter- 
mined by K2- the SF/^ state for K2 > I and the DW/^ 
state for K2 < 1. In the phase diagram shown in Fig. 
[3]Jb) , the region of relevant G^ is classified into four re- 
gions according to the most slowly-decaying correlation 
for the bosonic (6) and fermionic (/, tp) particles. 

Here we briefly discuss the correspondence to the re- 
sults obtained in Ref. ^^ in which the f-ip paired state 
is predicted within a mean-field analysis of a 3D model. 
It is pointed out in Ref. ,18 that the molecular conversion 
term induces a repulsive density-density interaction be- 
tween a fermionic atom and a molecule through lowest 
order virtual process. This effective interaction is con- 
sistent with the interaction vertex G^ > generated in 
our perturbative RG analysis. Furthermore, it is argued 
in Ref. [l^ that, if the bosons are condensed, the effective 
interaction between a fermionic atom and a molecule can 
become attractive, thereby yielding the SF order of "s- 
wave" f-ip pairing state. In the present ID case, the 
mean- field theory is invalid (bosons cannot condense), 
and the effective interaction G^ is repulsive. Therefore 
the s-wave f-ip pairing cannot be stabilized. Instead, we 
obtain a "p-wave" f-ip pairing (or out-of-phase DW state 
of / and ijj particle) which can be stabilized due to the 
induced repulsive interaction between / and ijj particles. 



2. Case of relevant Ge 

Next we consider the case where the phase field i^s 
is locked. The fluctuations of the (^3 field are divergent, 
and its order parameters exhibit short-range correlations. 
The order parameters of our interest are those involving 
"iJa, which can be simplified by replacing v2f^3 with its 
expectation value (v^i^a) = mod tt. The correlation 
functions of these leading order parameters exhibit alge- 
braic decay. 



(of(x)Oft(o)^^, 



o\ 



b//+bt^^(a;) C'b/z+bt^^lO) 



c^Kt^(-x;t;(o) 
</%(-)<;/, (0) 



(5.15a) 
a;~''''^ (5.15b) 

x-''''ie-''2'=^^, (5.15c) 



The correlation functions of the order parameters O?? (x) 
and 0^{x) also exhibit algebraic decay. However, these 
orders cannot dominate over those given in Eq. (j5.15p . 
since their exponents are always greater than those in 

Eq. dnn]). 



When Uft 



^/ 



i-jp 



and K 



f 



K^, the Hamilto- 



nian (J5.8I) takes a diagonal form, and the exponents are 
simplified to 






--2Kb + Kf, 

1 
2Kb + Kf ' 



Vf2 

m2 ■ 



Kf 



(5.16a) 



— . (5.16b) 



In the parameter region in Fig. [HJb) where Gg fiows to 
strong coupling, the exponent 77^1 is always smaller than 
the others in Eq. (|5.16p . Hence the SF^ state is desig- 
nated as the most dominant state. We also note that the 
SFf, correlation is enhanced as compared with the case of 
gzp = where mi -> l/{2Kb). 



VI. CONCLUSION 

In summary, we have carried out comprehensive study 
of a two-channel Bose- Fermi mixture, for which the anal- 
ysis and results presented here can possibly be applied 
towards more general many-body problems involving in- 
teracting multi-component quantum liquids. 

When the densities of the fermionic atoms and 
fermionic MB molecules are identical, the Feshbach 
molecule conversion/disassociation, the g^p term, can be- 
come relevant and induce an excitation gap, while the 
system retains two gapless modes. One of the appealing 
features is the existence of a dominant composite p-wave 
pairing state ^^^^, which occurs for fermions in both 
the open and closed hyperfine channels, induced by an 
effective interaction mediated by b atoms. Ultimately, 
we hope that the phase diagram presented here should 
demonstrate more general features of composite orders 
and indirect scattering processes that will manifest in 
higher dimensions. 

Although we have established the qualitative behavior 
of the phase diagram for a wide range of interaction cou- 
plings, a better comparison with experiments will require 
microscopic determination of the TLL parameters using 
numerical methods. 
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Appendix A: Two-coupled chain revisited 

The model which we consider in the present paper has 
a close connection to the model of spinless two chains cou- 
pled by the one-particle interchain hopping [3a, |42| . The 
model Hamiltonian for the two-coupled chains is given 
by 

-t^ J2 [ dx{^P^^P + h.c.) 

+ dx [g{pi pi + p2 P2) + 2.g'PiP2] , (Al) 

where p = L/ R refers to the left/right-moving particle 
and s = 1,2 is the chain index. The couplings g and 
g' represent the intrachain and interchain interactions, 
respectively [35i] . In earlier works, the interchain hopping 
term is diagonalized by introducing the bonding and anti- 
bonding band basis of the field operators, and then the 
bosonization and RG methods are applied to the field 
operators on the band basis [35|, |42| . In this appendix, we 
verify that the same results can be obtained by directly 
applying the bosonization to the field operators on the 
original chain basis. The bosonized forms of the field 
operators are given by 



*V«(. 



6 



^'=^ik F x^ifj) s{x)-\-i9 s{x) 



V2^ 



(A2) 



where s = 1,2 is the chain index, and S,s is the Klein 
factor satisfying ^1^2 — i- The commutation relation of 
the phase variables is [(l)s{x)^9s'{x')\ = Z7r<5s,s'0(— a;-f a;'). 
Since a dominant phase can be determined by the locking 
position of <j)s or 9s, we have to pay special attention to 
this commutation relation when we meet the products of 
vertex operators. 

With the symmetric and anti-symmetric combinations 
of phase variables, 4>± — {(fyi ± 02)/\/2 and 9± = {9i ± 
^2)/v2, the bosonized Hamiltonian is written as 



2tt 



+ 



+ 



dx 



1 



{d,c^+f + K+{dJ+f 



27r 



dx 



K^ 



-{d^<i>-f + K^idJ^f 






I dx cos \/20_ sin v2(/)_ 



/ (i2:cos2\/20_ 
Tra^ J 

^^^ [ dxcos2V29-, 



(A3) 



where K± c:i 1 - {g ± g')/{TTv), u± ~ u -h (5 ± sO/j. 
and G_L = 2tj_a/u^. The coupling constants G^ and Gg 



are initially zero but generated through the RG trans- 
formation. Only the asymmetric fields (0_ , 9- ) are sub- 
ject to the sinusoidal potentials, and the symmetric fields 
((/)+, ^+) remain free. 

The order parameters characterizing the ground state 
and their bosonized forms are given by 35|, |42| 



OcBW-ix)^^^^^^-^!^^^^ 






(A4a) 



OoAF(x)-*f*f-*^^*f 



e'^'"'^-'y^'i'+ cos V26'_ , (A4b) 



y20_. 



L,j,R 



sm 



Osc=(x) = *f*f + ^^*^ 



e*^**+cos\/26l_. 



(A4c) 



(A4d) 



where CDW^, OAF, SC*, and SC stand for charge- 
density wave, orbital antiferromagnetic, d-wave super- 
conducting, and s-wave superconducting states, respec- 
tively. 

In order to analyze the low-energy behavior for the </)_ 
mode, we apply the RG method. The RG equations for 
the coupling constants and the TLL parameter K_ are 
given by 



^=(^"%"2^'^^' 
dG 



(A5a) 



^^ = (2 - 2K^)G^ + IgIA^{{KZ' - X_)/2), 



(A5b) 



^ = (2 - 2KZ')Go ~ \GlMiK^ KZ')/2), 



dK^ 
"df 



(A5c) 
= -2GlKlA2{2K^) + 2GIA2 {2KZ^) , (A5d) 



where Ai{j3) is defined in Eq. (14.51) . We see from Eqs. 
(|A5b|) and (|A5cP that the one-loop RG processes yield 
positive and negative contributions of order G\ to G^ 
and Ge, respectively. Consequently, when K^ < 1, the 
coupling G^ is relevant and renormalized to strong cou- 
pling (G^ — > +00). In this case, the phase field <j)- is 
locked at (a/20-) — 7r/2 mod tt. On the other hand, if 
K- > 1, the coupling Gg is relevant and renormalized to 
strong coupling {Gg —> —00), and then the phase field 0_ 
is locked at (-\/2^-) = mod n. 

For K^ < 1 (i.e., g > g'), the relevant order param- 
eters, CDW^ and SC*, are reduced to OcDW''(a^) -^ 
gi2fcFX-«V20+^ Oscd(x) -^ e*^^+, as </>_ is locked at 
(-\/20-) = 7r/2 mod TT. These correlation functions show 
QLRO, 



O. 



CDW 



<^)Ol,^w40)) 



-iC_l_ i2kpx 



(A6a) 
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{Osc^ix)Ol^M) - ^-^"'^- 



(A6b) The dominant correlation is the OAF (SC*) state when 
K^<\ (X+>l),i.e., 5 + g'>0(5 + 5'<0). 



The dominant correlation is determined by the value of 
the TLL parameter Ky, the CDW (SC*) state becomes 
most dominant for Kj^ < 1 {K^ > 1), i.e., g + g' > 
(.9 + .9'<0). 

For K- > 1 (i.e., g < g'), the relevant order pa- 
rameters are given by OoAF(a;) — >■ e'^'^''^~'^^'^+ and 
OsC'{x) — >■ e'^^+, and their correlation functions are 



a 






— K+i2kf 



X 



-1/K+ 



The RG analysis described above correctly reproduces 
the phase diagram obtained in Ref. |42, which gives jus- 
tification for the method. As we noted earlier, the si- 
nusoidal potentials in the two-chain Hamiltonian (JA3| 
have similar forms as those in Eq. (|5.4p . We can thus 
study the phase diagram of our model using the same 

(A7a) RG method (with straightforward generalization) , as de- 
scribed in Sees. IV and V. The RG equations (|4.4p are 

(A7b) indeed similar to Eqs. ([M]) . 
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